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Faculty appointments and the 
record of scholarship 

Academic review committees would benefit from more details about 
the contributions made by individual researchers to papers with 
multiple authors, and also from more information about other types of 
scholarly communication. 
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Have you noticed that conversations about 
scholarly communication and academic 
careers often conclude with someone 
saying: 'Well, until university provosts flip the 
switch and start taking papers in open-access 
journals, the publication of data and code, digital 
monographs and so on into account when making 
decisions about promotion and tenure, traditional 
publications and metrics will continue to hold us 
all hostage'? 

I have lost count of the number of times I've 
heard arguments to this effect at academic 
library and publishing conferences, and I confess 
it is part of what drew me toward my current 
post as assistant provost for faculty appoint- 
ments and information at Harvard. If the prov- 
ost's office is where change in the dissemination 
of scholarship can be ignited, that's where I want 
to be. 

With a few years of first-hand experience in 
the administration of faculty appointments under 
my belt, I can report back — from the inside, as it 
were — that there is no such switch. It is much 
more complicated than a consensus on the part 
of university provosts to expand the set of works 
and measures that constitute solid evidence of 
academic distinction. That said, there is growing 
awareness that the search and review committees 
that appoint and promote academic staff have 
traditionally relied on information sources that 
may fail to portray the full picture. This is espe- 
cially true when the candidate's key contributions 
are not published in book or journal form, or 



when he/she publishes mainly or exclusively co- 
authored works. 

The importance of peers 

It would be imprudent to generalize about 
Harvard's criteria for the appointment and pro- 
motion of faculty since the policies and pro- 
cedures of the different Schools within the University 
all differ to a degree. And as Richard Zare, former 
chair of the chemistry department at Stanford 
University, described in a recent article (Zare, 
2012), elite research institutions in the United 
States, seemingly unlike most of the world's uni- 
versities, are not overly dependent on citation- 
based measures of impact such as impact factors 
for journals or h-indices for individuals. Rather, 
their appointment processes are time-intensive, 
more qualitative than quantitative or formulaic, 
and rely most heavily on peer review (both internal 
and external) to identify excellence. This type of 
peer review involves collecting confidential letters 
from a well-chosen set of peers: the purpose of 
these letters is to help academic review committees 
assemble a robust qualitative picture of a scholar's 
originality, independence, intellectual leadership 
and potential for future productivity and impact. 

In 2010, Nature carried out a survey in which it 
asked readers about the use of metrics in deci- 
sions about new hires and tenure {Abbott et a/., 
2010). Three-quarters of the 150 readers who 
replied thought that metrics were being used in 
hiring decisions. However, provosts and other 
administrators contacted by Nature painted a 
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different picture: 'Metrics are not used a great 
deal,' said Alex Halliday, head of the mathemat- 
ical, physical and life sciences division at Oxford 
University. 'The most important things are the let- 
ters, the interview and the CV, and our opinions 
of the papers published.' Claude Canizares, vice 
president for research and associate provost at 
the Massachusetts Institute of Technology, had a 
similar message: 'We pay very little attention, 
almost zero, to citation indices and counting 
numbers of publications'. 

While the letters that inform faculty appoint- 
ments usually succeed in bringing the key consid- 
erations to light, I believe we could make the 
work of search and review committees easier 
and more reliable if we enhanced our sources of 
information about scholarship and contribution in 
ways that I describe below. 

We could make the work of search 
and review committees easier and 
more reliable if we enhanced our 
sources of information about 
scholarship and contribution. 

A broader record of scholarship 

When a scholar's portfolio includes works out- 
side of the published record of books, journal 
articles and conference proceedings, search and 
review committees often have to dig deeper to 
gauge the academic impact of those works. In 
the visual arts, for example, they may consult 
exhibition histories and published critiques, in 
addition to external reviews from a wider set of 
peers that might include curators and fellow 
artists. In the sciences, a candidate may have 
contributed meaningfully to his or her field by 
making data or software code widely available. In 
such cases, there is no choice at present but to 
rely on peer testimony to weigh the significance 
of the contribution. 

Researchers and review committees alike 
would benefit greatly from the development of 
standards for the identification and citation of an 
extended set of scholarly works including data, 
software and code, multimedia and internet com- 
munications, so that such contributions are more 
readily integrated into our evolving digital schol- 
arly ecosystem. The just-launched ORCID network 
[http://www.orcid.org], which aims to provide 



every researcher in the world with a unique iden- 
tifier linked to academic outputs and activities 
(see Figure 1), may provide a new way for schol- 
ars to associate themselves within this ecosys- 
tem with a wider array of scholarly contributions. 
In the sciences, standard methods for citing 
data and attributing credit for the generation of 
quantitative data are near-term priorities {Altman 
and King, 2007; National Research Council, 
2012). 

Contributorship versus 
authorship 

For the purposes of academic review, the trad- 
itional publication list is especially problematic 
when it comes to scholars with many multi- 
authored works. This is because author lists don't 
provide clear information about who contributed 
what in large-scale research and writing collabor- 
ations, which are increasingly common in the 
physical and life sciences. Author lists take a 
complex network of collaboration and effec- 
tively reduce it to a one-dimensional informa- 
tion source, where all we have to go by is order 
of names to convey author role and rank. Different 
fields of scholarship have adopted different prac- 
tices around author order, but middle authors are 
always at the greatest risk of losing out on attri- 
bution and credit because their perceived contri- 
bution is diminished relative to first and last 
authors in collaborative works. In fields that list 
author names in journal articles alphabetically, 
such as economics, it has even been observed 
that you are more likely to get tenured in a top 
department if your surname begins with a letter 
earlier in the alphabet {Einav and Yariv, 2006). 
The unintended consequences of our authorship 
practices are far from benign for researchers and 
for science. 

There is growing interest among researchers, 
funding agencies, academic institutions, editors 
and publishers in increasing the transparency of 
research contributions, and in more fine-grained 
tracking of attribution and associated credit. 
Many publishers now require contribution disclos- 
ures upon article submission — some in structured 
form, some in free-text form. There is now a clear 
need for a standard vocabulary of contributor 
roles that captures what each named author con- 
tributed to a particular publication — for example, 
conceptual framework, methodological design, 
data collection, data curation, experimental proced- 
ures, programming, software, statistical analysis, 
investigation, instrumentation, writing, illustration, 
project management, funding, laboratory head 
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Figure 1. The ORCID (Open Researcher and 
Contributor ID) initiative aims to provide every 
researcher in the world with a unique identifier linked to 
his or her academic outputs and activities. This figure 
shows Amy Brand's ORCID page. 



and so on. With the development of contributor 
role vocabularies and tagging mechanisms, the 
review committee of the future reading a tenure 
application from, say, a biostatistician who is usu- 
ally a middle author in multi-authored works, will 
more readily be able to detect that the individual 
consistently contributes innovative methodologies 
to his or her research collaborations {IWCSA, 2012). 

Imagine how the academic appointment pro- 
cess might change if search and review commit- 
tees had access — within an appropriately tagged 
or linked online CV, for example, or via the ORCID 
system — to information about the specific contri- 
butions made by a candidate to each of his/her 
works, including contributions that might not other- 
wise have qualified for 'authorship' status? While 
a future scheme of standardized contributor roles 
integrated with the ORCID identifier system may 



lead to the development of new quantitative 
metrics, I am much more interested in having 
more precise information about researcher con- 
tribution made transparent in our information 
resources. On-going developments in academic 
publishing, along with the semantic capabilities 
of the web, should make this possible before too 
long. 
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